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In a method and apparatus for analysing an elec- 
tronic image signal, the signal is treated as representing 
one or more cells each comprising a plurality of pixels. 
A set of pointers is generated and sequentially set ac- 
cording to characteristic values related to detailed im- 
age content The pointers are used to address a memory 
array and for successive frames, the value of an address 
in each array row indicated by the pointer correspond- 
ing to that row is updated. In this way, for each frame 
the characteristic values can be accumulated so that in z 
single operational mode, both a time history of the im 
age, stored in a memory, is updated and an indication is 
produced indicative of the occurrence or non-occur- 
rence of an event not associated with image back- 
ground. The characteristic values can be generated by 
randomly or pseudo-randomly selecting pairs of pixels 
and for each, generating a binary signal depending on 
whether or not the intensity of incident light on a prede- 
termined one of the pair is greater than the intensity on 
the other. Over all the rows, the values in the addresses 
being updated can be summed, as well as the maximum 
value in each row. The ratio of the two sums can be time 
weighted averaged with respect to the ratios obtained 
from previous frames. The ratio is compared with the 
average and the result used to determine the occurrence 
or non-occurrence of a significant event within the im- 
age. 
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IMAGE ANALYSER 

The present invention relates to a method of image 
analysis and an apparatus for carrying out the method. 
The invention is particularly, although not exclusively, 
suited to surveillance applications. 

OS Patent 4 249 207 relates to a surveillance system in 
which an image received by a television camera is 
divided electronically into an array of cells or 
♦ tiles' . The tiles are dimensioned to allow for 
perspective, so that they each cover substantially the 
same area regardless of the particular part of the image 
to which they respectively correspond. This is 
illustrated in Figure I of the accompanying drawings. 
The system monitors each cell to determine whether a 
potentially significant event is occurring in each 
cell. If such an event is detected in one cell, 
neighbouring cells are checked and if an event is 
occurring in, say two, of these, it is taken as 
indicative of a track of a moving person or object of 
interest. 

Occurrence of a potentially significant event in a cell 
is determined according to changes in the average light 
intensity received from that cell. Each cell consists 
of an array of pixels. These are analysed line by line 
and the integrated incident light intensity for that 
cell is computed. Over time, a weighted comparison is 
continuously made between the average present intensity 
and the average intensity in a previous frame. If the 
result of this comparison exceeds a predetermined, 
threshold, then that is taken as a potentially 
significant event occurring in that cell. 
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The aforementioned US Patent states that this system 

provides good discrimination against false events such 

as moving cloud shadows. However/ that system is best ^ 

suited to generally empty scenes such as the area 

between two perimeter fences sited in an open ^ 

landscape. It is much less able to discriminate against 

false events in a busy scene, such as may occur in an 

urban enviroiunent- I 

Specific disadvantages of this known system are: • 

a. It is overly sensitive to certain small 

variations in the image g. due to weather changes, * 
clouds, tree movement, etc. This leads to a large 
number of false alarms resulting from, normal . changes in 
a scene; 

b. it has low sensitivity to certain large I 
variations in the image, eg. a small light change spread 

across a tile has the same effect as a large light 
change in part of a tile. This can cause some events of 
interest to be missed; and 

c. large changes in the image desensitise the 
system for a while. As a result, a return to a normal 
scene will cause an activity alarm, and this reduces the 
ability to track movement and identify the shape of 
objects, since tiles vacated by a slow object have the 
same activity as a tile being entered by the object. 

The above problems explain why this existing system is 
only effective in scenes with very little variation in 
light levels. In fact it is only effective for 
monitoring indoor scenes or outdoor scenes where there 
is no expectation of movement, e. g. dead zones between 
fences surrounding a prison. *~* 
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The present invention in its various aspects has a 
significant advantage over that described in the 
aforementioned OS patent in that it provides the ability 
to ' learn' the nature of a complex backround. This 
enables it to discriminate better for genuine events of 
interest in an otherwise crowded or busy scene. 

Another previously known system called ' WISABD' is 
described by I. Aleksander et al in Sensor Review, July 
1984, pp 120-124. Pixels within a cell are interrogated 
pseudo-randomly. In the latter disclosure it is stated 
that the intensity of light incident on a pixel can be 
converted to a Grey-scale signal or alternatively, 
binetry signal. 

in the latter case, the detected light level is compared 
with a threshold and a 1 or 0 is set according to 
whether the intensity is below the threshold or not. 
These binary signals are then combined into groups, 
which form pointers into an array stored in a random 
access nemory (RAM).* Bach time an array element is 
addressed by a pointer, its value is set to "on- 
otherwise it is left unchanged. This process is carried 
out over a number of "frames". 



Thus, with WISARD, over successive frames, values in 
certain elements of the array become set. This is in 




> . After 8 




have elapsed, the array is considered suitably primed 
and the system is put into run mode and pointers are 
generated in the same way. Then, if a pointer addresses 
an element which is set, this indicates that the 
intensities in pixels forming the pointer are similar to 
values which occurred in the training set. Pointers 
which address elements which are not set indicate that 
the situation is different from the training period. In 
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It will ie appareni: that WISAM can only compare the 
present situation with what happened dxiiing its finite 
i training' period and has no memory for events before or 
since. Also^ transient events in the training period 
have as much effect as common events. As a result, 
WISARD cannot continuously improve its record of 
background, and so is limited in its ability to 
discriminate between significant events and the 
bacJcroimd. 

The present invention is capable of continuously 
improving its record of the background and so can 
provide better discrLmination than HI SARD. 

A first aspect of the present invention provides a 
method of analysing an electronic image signal, the 
method comprising: - . 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a 
plurality of pixels; 

(b}for consecutive frames of the monitored image, 
generating characteristic values according to the 
detailed content of the image; and 

(c)for consecutive image frames, accumulating the 
characteristic values so that in a single operational 
mode, both a time history of the image, stored in a 
memory, is updated and an indication is produced 
indicative of the occurence or non-occurence of an event 
not associated with image background. 

The first aspect of the invention also includes a device 
for analysing an electronic image signal, the device 
comprising electronic means for effecting steps (a)-(c) 
in the aforementioned method. 



Tiie present invention in general, mitigates the problems 
of the prior art referred to above and can extend the 
possibilities for scene monitoring to a wider variety of 
scenes. In particular, the invention is suited to 
monitoring scenes with a large amount of normal 
activity, for example to monitor busy street scenes to 
identify specific events. Examples of such events are: 

- arrival of an obstruction on a railway line, 

- arrival or departure of a' vehicle through a gate, 

- arrival or departure of a person through a door, 

- occurence of congestion on a railway platform. 

Although in its widest definition, the first aspect of 
the invention requires only one cell, it is preferred 
that the image is represented as a plurality of cells, 
most preferably adjusted for perspective as hereinbefore 
described. 

A preferred method of generating the characteristic 

values is to randomly or pseudo-randomly select pairs of 
pixels and for each pair, generate a (preferably binary) 
signal in dependence upon whether or not the intensity 
of light incident on a predetermined one of the pair of 
pixels is greater than the intensity of light incident 
on the other. 

Thus, a second aspect of the present invention provides 
a method of analysing an electronic image signal, the 
method comprising: * 

(a) proces6ing the image signal to regard it as 
representing one or more cells each comprising a 
plurality of pixels; and 

(b) for consecutive frames of the monitored image, 
randomly or pseudo- randomly selecting pairs of pixels 
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in the cell or cells, as approprxa'ter and for eacli pair, 
generating a binary signal in dependence upon whether or 
not the intensity of light incident on a predetermined 
one of the pair of pixels is greater than the intensity 
of light incident on the other* 

The second aspect of the invention also includes a 
device for analysing an image signal, the device 
comprising electronic means for effecting steps (a) and' 
(b) of the method according to the second aspect of the 
invention. 

Preferably at least one pair of pixels is so selected 
for each of a plurality of cells. It is also much 
preferred to select in the same way, a plurality of 
pixels for each cell of the image field. 

Once one or more pairs of pixels are selected in a given 
cell, the same pixels can then be used in stibseouent 
frames until the end of the operating session. In a 
subsequent session, the same pairs could be tised again 
or different pairs selected for the remainder of that 
session. 

When a plurality of pixel pairs are used in a given 
cell, it is possible for the same pixel to be used in 
more than one pair, although this is not absolutely 
necessary. It is also possible, although not mandatory, 
for one or some of the pixels not to be used~ In any pair. 

For different cells, the pair or pairs of pixels could 
be chosen at the same relative positions in each 
although again, this is not necessary. 

He also prefer utilising the characteristic values to 
generate pointers for addressing the memory containing 



the time history of the image. A particiilarly 
advantageous means of doing this is to generate a set of 
pointers a ,...,^^, each of n binary bits and 
sequentially setting these bits according to the 
respective binary values of the signals resulting from 
the comparisons of the pixel pairs. In other words, 
pairs 1, . . . / n of the pixel pairs are used to set the 
values of a {l,...,nj then pairs (n+1 ),..., 2n are 
used to set a (l,.../n) and so on. 

Therefore, a third aspect of the present invention 
provides a method of analysing an electronic image 
signal, the method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each conqprising a 

plurality of pixels; 

(b) for consecutive frames of the monitored image, 
generating characteristic values according to the 
detailed content of the image; and 

( c ) generating a set of pointers a^, — , a^, 

each of n binary bits and sequentially setting these 
bits according to the characteristic values. 

The third aspect of the present invention also includes 
a device for analysing an image signal, the device 
comprising electronic means for effecting steps (a)-{c) 
of the methcd according to the third aspect of the 
invention. 

The values of n and m may be any convenient and may be 
the same or different, but n x n will be equal to the 
number of characteristic values. Therefore, in the 
context of the second aspect of the invention, noc m 
will be equal to half the number of pixels selected in 
each cell. 
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In a preferred embodiment, these pointers are used to 
address a memory comprising an array of addresses 

comprising rows 1, . . . , m and columns 1, ., 2^. When 

the characteristic values have been used to set the 
values of the pointers , the latter address the memory as 
follows. Pointer a^ addresses row 1. The pointer 
contains a binary number of value somewhere between 0 ■ 
and 2 . The pointer points to the column in row I 
having a column number corresponding to the value in 
a^. The value in that address is then incremented 
by 1 (at the outset, all addresses will be set to 
zero). This is done for all rows up to m. In the next 
frame, the whole process is repeated, updating the value 
by 1 in a particular address pointed to in each row. 

Therefore, a fourth aspect of the present invention 
provides a method of analysing an electronic image 
signal, the method comprising: • 

{a)processing the image signal to regard it as 
representing one or more cells each comprising a 
plurality of pixels; 

(b) for consecutive frames of the monitored image^ 
generating a set of pointers each containing a value 
related to the detailed content of the image; and 

(c) using the pointers to address a memory array and 
for successive frames, updating the value of an address 
in each row of the array indicated by the pointer 
corresponding to that row. 

The fourth aspect of the present invention also includes 
a device for analysing an image signal, the device 
comprising electronic means for effecting steps (a) -(c) 
of the method according to the fourth aspect of the 
invention. 

In a preferred embodiment, the set of pointers comprises 
* ' " ^ oa/»Vi nf n binarv bits and the 
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It will be appreciated that in terms of a memory array, 
the terms ' rows' and ' columns' are purely arbitrary and 
therefore may be transposed. 

A further advantageous feature of the invention is the 
way in which the values in the memory are used to 
discriminate between the background and unusual or 
unexpected occurences. In successive frames, for each 
row in the memory, the maximum -value at any address in 
the row is determined, the value currently pointed at 
also being known. For all the rows, the ratio of the 
sum of values in currently pointed to addresses, divided 
by the sum of the maxima is calculated. This ratio is 
compared with a time weighted average for the same ratio 
from previous frames. If this ratio is less than a 
chosen proportion of the time weighted average then it 
is taken as indicative of an unusual or unexpected event 
occuring in the relevant cell. 



Thus a fifth aspect of the present invention provides a 
method of analysing an electronic image signal, the 
method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a 

plurality of pixels; 

(b) for consecutive frames of the monitored image, 
updating one address in each row of a memory array in 
dependence on the detailed content of the image; and 

(c) over all the rows, summing the values in the 
addresses being updated and summing the maximum value in 
each row, subjecting the ratio of the two sums to a time 
weighted averaging with respect to the ratios obtained 
from previous frames, comparing the ratio with the time 
weighted average and using the result to determine the 
occxxrence or non-occurence of a significant event 



10 

The fifth aspect of the present invention also includes 
a device for analysing an image signal, the device 
comprising electronic means for effecting steps (a)-Cc) 
of the method according to the fifth aspect of the 
invention. 

When the present invention in any o£ its aspects is 
manifested as a device as opposed to a method, the 
device may be implemented as hardware /firmware arranged 
to operate under the control of appropriate software or 
it may be realised in terms only of hardware/firmware 
configured from logic gates, flip-flops etc, arranged to 
carry out the required functions. . 

The invention will now be illustrated by way of the 
following description of a preferred embodiment and with 

* 

reference to the accompanying drawings in which: * 

Figure I shows the arrangement of cell boundaries to 
take account of perspective; 

Figure 2 is a diagramatic representation of a device 
according to the present invention, for cooiputing 
activity levels; 

Figure 3 is a block diagram of the hardware of the 
device shown in Figure 2; 

Figure 4 is a flowchatrt showing the logic applied to 
each cell to determine the existence or absence of a 
track; and 

Figure 5 shows the spatial relationship of local 
cells for movement from top right to bottom left. 
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Before describing the preferred embodiment in detail it 
is convenient first to define the following terms, these 
definitions applying only to the described embodiment 
and not limiting the scope of the claimed invention: - 



Pixel 

A pixel (picture element) defines a grey level at a 
point in an image. Typically up to 256 grey levels are 
represented in 8 -bits. 

Image 

An image is an array of pixels, typically 512 x 512. 



Tile 

A tile (cell) is a subset of an image made up of N 
pixels. N must be even. The pixels in a tile are 



P / P ^ # • • • 9 



i 3 



Let M = N/2. 

Pixel Ordering 

The pixels are randomly ordered and divided into two 
halves: 

Pj# P,' • • ' ' Pm' 
Pointer Generation 
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Generate bits b^/b^, b^, . . . , bjj as: 



if p >g^ then b^-0 else b^» 1, 
if p >g then b =0 else b = 1, 

• » » 

Let m = M/n- 

Generate m n-bit binary addresses: 
a = [b b b ,.b_], 

• • • 

*m = ( ...bjj_jbjjj. 

The m addresses a^, a^, a„ characterise 

the instantaneous image in the tile and act as pointers 

into the memory array defined below. 

Memory 

Memory is an m x 2^ array of data values holding 
information about the past history of the scene. This 
array is continually updated as the process proceeds. 

* 

In addition, the maximum value in each row of Memory is 
maintained in an array max. The notation is that, for 
•3 a 1, ... ,m: 

max. = maximum of Memory [j,i J, i^l, .../2 . 

Address a. points to a cell in the ^th row of the 
memory. This cell is denoted: 

Memory[j,a. 1- 
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Frame Rate 

Image frames are processed at a chosen rate, which will 
be application specific. The time at which the current 
frame is processed is denoted by t, and the time at 
which the previous frame was processed is denoted t-1. 



Parameters 

Parameters f, UpperLimit and k are selected to determine 
time constants over which a history is required. 

Threshold is a parameter which determines the detection 
sensitivity of the technicpie. 

The purpose of the mechanisms is to compute, for each 
tile, an activity level indicating if the image is in a 
normal state. 

# 

The mechanisms are implemented by the following means: 

a. a T7 camera which captures images and outputs 
these images in a standard format, 

b. an Image Frame Grabber which captures the images 
at the frame rate of the camera, digitises each frame 
and stores it in a digital frame buffer, 

c. a Computer Processor which performs Pointer 

Generation by 

accessing the Image Frame Buffer and 
computing pointers into a Memory array, 

d. a Digital store, the Memory array, to accumulate 
statistics about Images, 

e- a Computer Processor which uses the pointers to 
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increment the Memory array (Memory Update), 

f. a Computer Processor which accesses the Memory 
array to compute measures of Activity in the Image. 

The Computer Processors in c), e) and f) may be a single 
processor, or these activities may be distributed across 
several processors. 

Running the process is preceded by defining tiles and 
pixel orders. The choice and size of tiles is 
application specific. 

When running, images are captured in the Frame Buffer at 
the frame rate of the camera. The Computer Processors 
then carry out the following actions relating to each 
frame analysed. The Conputztion is described below and 
is carried out for each tile and the relationship 
between the separate processes is represented in Figure 
2 and the precise nature of the computer hardware is 
shown in Figure 3. 

Pointer Generation . 

Generate pointers into the Memory^ as follows- 

For each j = 1, . . . , a 

generate address a^, as described above. 

Memory Update 

Perform Memory Update to maintain a history of past 
images as follows: 

For each j = 1, ...,n 

Increment Memory lj,a. J by 1, and 
update max. to be the maximum element in the 
jth row of Memory. 



wo 93/05488 PCr/GB92/01669 

15 

If Memory Ij^a^l > UpperLiait then scale the 
jth row of Memory, ie: 

Compute MemoryIj,i] = f* Memory{j,il, i= 1 2 ' 

and compute max. = f* maXj. 

Image AssesBment 

Perform Image Assessment to determine the current s 
of the image by computing a Score, to be compared 
an Average Score. 



sum the values Memory I j, a^ 1, j = l,....ni, denoted 



Sum the values max^, j « denoted Maximum, 

calculate a value A^ defining the instantaneous 
Activity in the image at time t iy computing: 
A. = score /Maximum, 

(Note: A^ can take values between 0 and 1). 
calculate the Average Activity in the image at time 
t .by computing: 

Average^ = k* Average^.^ ♦ (l-k)*A^ 
(Note: Average^ can take values between 0 and 1). 
calculate the measured Activity^ at time t by: 
Activity^ = (Average^ - A^) 

(Note: Activity^ can take values between -1 and 1). 
If Activity > Threshold then indicate that the 
Tile is Active. 

The overall technique described above derives a single 
value (Activity^) which indicates whether the current 
scene has changed from recent scenes. The time frame 
over which the change is being determined is specified 
by choice of the parameters f and k. For example; for a 
slowly varying background scene values of f and-k close 
to 1 could be used. Smaller values would be necessary 
where the background scene changes rapidly. 
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Unlike other previously known schemes, the technicjue is 
sensitive to real changes to the scene and dispriminates 
between these and typical acceptable changes to the 
scene. This is because the memory array remembers the 
characteristics of a normal scene. 

The calculation of the pointers as described above is 
very sensitive to local changes in a tile, but is 
insensitive to global light changes in a tile- Each 
pointer causes a location^ in Memory to be incremented* 
Thus scenes which are common will cause certain Memory 
locations to be incremented frequently, whilst other 
locations will be incremented rarely. 

Whilst a scene is in a common state (note that the light 
levels may be changing significantly and the content of 
the scene may be changing) then the pointers will be 
addressing Memory locations containing large values. 
Then the derived values of Activity will be small or 
negative. 

However, when an unusual change occurs in the image, 
this will affect several pointers which will now address 
Memory locations containing low values. The resulting 
value of Activity will then be high (ie. close to 1). 

In this way, the technique immediately identifies 
changes in the image. A local change, caused for 
example by a person moving in the scene, may affect only 
a small number of pixels. Suppose, for example that ten 
pixels are affected, then because of the way the 
pointers are generated, this change will typically 
affect ten pointers. Thus a small local change will 
have a large affect on the Activity score. 
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Also, because of the way the Menoxry remembers past 
scenes, when the activity ends the computed Activity 
immediately reverts to a small value. In this way the 
presence or absence of an event in a tile can be 
monitored accurately. 

The result of the computations is to derive, for each 
image processed, an attribute Active, which can take the 
value true or false, for each tile. These Active values 
can be input to a process which determines the nature of 
an event in the scene. Such a process can track events 
and compute shape and size attributes of objects in the 
scene. The reliability of the claimed procedure for 
identifying active tiles, as opposed to ambient light 
changes, makes it possible to perform Event Recognition 
successfxilly. 

In general, the number of pixels in a tile is 
application specific. The size of a tile will depend 
upon the size of object to be identified in the scene. 
Also, because of perspective, the number of pixels in 



In the same way, the number of pixel pairs in a tile, M, 
is also application specific and tile specific. In 
general not all pixels in a tile need be considered and 
pixels can generally be undersampled. However, given 
the definition in the present preferred embodiment, M 
should be no smaller than 8. 

In order to exploit the 8-bit memory addressing of 
modern computers, n is generally selected as 8. Also, 
elements of Memory are typically 8-bit locations, and so 
Upper Limit woxild normally be chosen as 255. 
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Each tile Is processed separately, and generates m 
pointers into the Memory array. In practice, more 
sensitivity can be gained by repeating the pixel 
generation a number of times, to define more pointers. 
Typically three re-orderings of pixels are used, 
generating 3m pointers which implies a Memory array of 
3m X 2^ elements. 

The rate at which images are processed is typically 25 
frames per second. This could be leas depending on the 
rate at which events occur in the scene. The mechanism 
incorporates flexibility so that the system can be 
implemented on a single computer or several computers 
depending on the frame rate required. 

The processing mechanisms previously defined show how 
each tile is assessed to see if it is Active, The 
determination of events in the scene can then be carried 
out by consideration of how the Activity values vary 
temporally and spatially. 

In contrast to other previously known schemes, the 
determination of events can be carried out success fiilly 
using simple logic based on Activity values. This is 
because the claimed mechanisms reduce the false, alarm 
rate, i. e. the rate at which tiles are indicated as 
Active when they are not. 

The active values can be used to Track objects passing 
through the scene. In this case a tile has the 
additional attribute Track, which can take the value 
true or false, to indicate if an object is currently 
passing through that tile. 
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The logic applied to each tile is indicated in the 
Flowchart presented in Figure 4. The tests are applied 
at time step t based on the Active value at time t and 
the Track values at time t-1. 

Tracks in an arbitrary direction are determined by 
defining local tiles to be: 

a. all tiles contiguous to the tile of interest, 
including/ 

b. the tile itself. 

TO detect movement in a particular direction, "local 
tiles- is defined accordingly. For example as indicated 
in Figure 5 to track movement from the top right to the 
bottom left of a scene, local tiles would be chosen to 

be: 

a. contiguous tiles above and to the right of the 
tile of interest, and 

b. the tile itself. 

which have a Track value of true can be indicated 
on an image to show moving objects. Also, a combination 
of track direction can be used to detect objects which 
exhibit specific behaviour, e. g: 

* 

a. movement down followed by across the image, 

b. an object moving in a specific direction and then 
pausing in the image (see below), 

c. an object moving through the scene and then 
passing through a door, or vice versa. 
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The Active and Track values can be used to detect 
objects which move into the scene and then stop. This 
is achieved by counting for each tile, the consecutive 
frames for which the tile has a Track value of true- 
The event is identified when this count passes a 
prescribed threshold. 

This process can identify, for example, a vehicle 
parking in a busy street, or a person loitering in a 
busy waikway-r 

Various aspects of the present invention may also be 
embodied in the Icnown HISARD system hereinbefore 
described. It will now be explained how WISARD can be 
so adapted. 

The original WISARD system involves generation of 
pointers into a binary memory array for a fixed period, 
i. e. , a fixed number of frames. The scheme is 
unsuccessful because: 

a. it cannot adapt to changing scenes, and is 
therefore only applicable to fixed scenes, 
it is very sensitive to certain small light . 
changes because of the way it replaces a grey 
scale image by a binary (black/white) image. 

Sxiitably modified, a combination of the WISARD Pointer 
Generation together with the Memory Dpdate and Image 
Assessment of the present invention can be more 
effective. The following description identifies these 
modifications in presenting a Pointer Generation scheme 
which can be very effective so long as the images 
processed have a large contrast (i. e. a wide range of 
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light levels). The notation is essentially the same as 
used hereinbefore and has the same meanings. 

Given a threshold T^, bits b , b^. . . , bjj 
are generated as follows: 

If P >T then b -0 else b = 1, 
if P >T then b =0 else b = 1, 

2 2 2 2 

• • • 

if PjpT^ then h^^O else 

Generate 1 n-bit binary addresses, where 1 = N/n 

a = { b b ... b^ 1 / 
119 n 

a s^Eb b . . . b 
J ^ n+i n+2 2n" 

■ 

pointing to an 1x2^ memory array. 

This method of pointer generation is sensitive to choice 
of threshold T^. In particular, an object which is 
a similar grey level to the background may have no 
effect on the pointers. This deficiency can be reduced 
by maintaining a second 1x2^ memory array and deriving a 
second set of pointers as follows: 

If T <P <T then b = 0 else b =1, 

113 1 i 

if T <P <T then b = 0 else b =1, 

12 3 2 2 



. • • 



if T <Pjj<T^ then bjj = 0 else bjj = 1 
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In the same way as above, a second set of 1 n-bit 
addresses are generated from this second set of bits 
b b , b„, which act as pointers into the 

1,2, N 

second memory array. The Activity values derived from the 
two memory arrays are then averaged to give an accumulated 
Activity. 

Then if the threshold T T T are carefully 
choseni^ a scheme based upon these pointers can also be 
success ful^ 

The threshold must be chosen to accommodate to variation 
in light level across the image. An effective way is to 
adjust them so that^ across the whole image (i.e. across 
all the tiles): 

25% of pixel values are less than T 
25% of pixel values lie between T and T 
25% of pixel values lie between T^ and T^ 
25% of pixel values are greater than T 

Then T T and T must be adjusted for every 

1/3 3 

image which is processed. 

Clearly, this scheme could be extended to accommodate more 
light levels by introducing more thresholds. 
These Pointer Generation techniques are specific examples 
of a general process which generates bits b^ (taking the 
values 0 or I) as a function of pixel pairs and 
parameters. Thus the examples given take the form: 

if p> q then b - 0 else b - 1 
if p> T then b = 0 else b =^ 1 • 
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A further example is: 

if p > q * epsilon then b = 0 else b = 1, 

where epsilon is a fixed parameter value determined by the 
level of noise present in the image (due to camera and 
transmission effects). 
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CLAIMS 

1. A method of analysing an electronic image signal, the 
method comprising; - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
generating a set of pointers each containing a value 
related to the detailed content of the image; and 

(c) using the pointers to address a memory array and 
fox successive frames, updating the value of an address in 
each row of the array indicated hy the pointer 
corresponding to that row» 

2- A method according to claim 1, wherein the set of 
pointers comprises pointers a^,. . . . * , a^, each af n 
binary bits and the memory array has m rows and 2^ 
columns. 

3. A method according to either preceding claim, further 
comprising over all the rows, summing the values in the 
addresses being updated and summing the maximum value in 
each row, sxU^jecting the ratio of the two sums to a time 
weighted averaging with respect to the ratios obtained 
from previous frames, comparing the ratio with the time 
weighted average and using the result to determine the 
occurrence or non-occurrence of a significant event within 
the image. - 

4. A method according to claim 2, wherein the binary bits 
of the pointers are set in accordance with characteristic 
values generated for consecutive frames of the monitored 
image according to the detailed content of the image. 

5. A method according to clcd.m 4, wherein the 
characteristic values are accumulated for consecutive 
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image frames so that in a single operational mode, both a 
time history of the image, stored in a memory, is updated 
and an indication is produced indicative of the occurrence 
or non-occurrence of an event not associated with image 
background. 



6. A method according to claim 4 or claim 5, wherein the 
characteristic values are generated by randomly or 
pseudo- randomly selecting pairs of pixels and for each 
pair, generating a signal in dependence upon whether or 
not the intensity of light incident on a predetermined one 
of the pair of pixels is greater than the intensity of 
light incident on the other. 

7. A device for analysing an electronic image signal, the 
device comprising electronic means for: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
generating a set of pointers each containing a value 
related to the detailed content of the image; and 

(c) using the pointers to address a memory array and 
for successive frames, updating the value of an address- in 
each row of the array indicated by the- pointer 
corresponding to that row. 

8.. A device according to claim 1, wherein said electronic 
means is adapted to generate said set of pointers as 
pointers a., . . . , a , each of n binary bits and the 
memory array has m rows and 2 columns. 

9. A device according to claim 7 or claim 8, wherein said 
electronic means is adapted for, over all the rows," 
summing the values in the addresses being updated and 
summing the maximum value in each row, subjecting the 
ratio of the two sums to a time weighted averaging with 
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respect ta the ratios obtained from previous frames, 
comparing the ratio with the time weighted average and 
using the result to determine the occurrence or 
non*occurrence of a significant event within the image. 

10. A device according to claim 8, wherein said electronic 
means is adapted to set the binary hits of the pointers in 
accordance with characteristic values generated for 
consecutive frames of the monitored image according to the 
detailed content of the image. 

11. A device according to claim 10, wherein said 
electronic means is adapted to accumulate the 
characteristic values so that in a single operational 
mode, both a time history of the image, stored in a 
memory, is updated and an indication is produced 
indicative of the occurrence or non-occurrence of an event 
not associated with image background.^ 

12. A device according to claim 10 or claim 11, wherein 
said electronic means is adapted to generate the 
characteristic values by randomly or pseudo-randomly 
selecting pairs of pixels and for each pair, generating a 
signal in dependence upon whether or not the intensity of 
light incident on a predetermined one of the pair of 
pixels is greater than the intensity of light incident on 
the other. 

13. A device according to any of claims 8 to 12, wherein 
said electronic means comprises an image frame grabber, a 
memory and one or more computer processors. 

14. A method of analysing an electronic image signal, the 
method comprising: - ..^ 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 
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(b) for consecutive frames of the monitored image^ 
generating characteristic values according to the detailed 
content of the image; and 

(c) for consecutive image frames, accumulating the 
characteristic values so that in a single operational 
mode, both a time history of the image, stored in a 
memory, is updated and an indication is produced 
indicative of the occurrence or non-occurrence of an event 
not associated with image background. 

15. A method according to claim 14, wherein the image is 
represented as a plurality of cells. 

16- A method according to claim 15, wherein said plurality 
of cells is adjusted for perspective. 

17, A method according to any of claims 14 to 16, wherein 
the characteristic values are generated by randomly or 
pseudo-randomly selecting pairs of pixels and for each 
pair, generating a binary signal in dependence u]don 
whether or not the intensity of light incident on a 
predetermined one of the pair of pixels is greater than 
the intensity of light incident on the other. 

18. A device for analysing an electronic .image signal, the 
device comprising electronic means for: - 

(a) proce66ing the image sigxial to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
generating characteristic values according to the detailed 
content of the image; and 

(c) for consecutive image frames, accumulating the 
characteristic values so that in a single operational 
mode, both a time history of the image, stored in a 
memory, is updated and an indication is produced 
indicative of the occurrence or non-occurrence of an event 
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not associated with image background. 

19. A device according to claim 18, wherein the image is 
represented as a plurality of cells. 

20. A device according to claim 19, where said electronic 
means is adapted to adjust said plurality of cells for 
perspective. 

21. A device according to any of claims 18 to 20, wherein 
said electronic means is adapted to generate the 
characteristic values by randomly or pseudo-randomly 
selecting pairs of pixels and for each pair,, generating a 
binary signal in dependence upon whether or not the 
intensity of light incident on a predetermined one of the 
pair of pixels is greater than the intensity of light 
incident on the other. 

22. A device according to any of claims 18 to 21, wherein 
said electronic means comprises an image frame grabber, a 
memory and one or more computer processors. 

23. A method of analysing an electronic image signal, the 
method comprising: - 

(a}processing the image signal to regard it as 
representing one or more cells each comprising a pixxrality 
of pixels; and 

(b)for consecutive frames of the monitored image, 
randomly or pseudo-randomly selecting pairs of pixels in 
the cell or cells, as appropriate, and for each pair, 
generating a binary signal in dependence upon whether or. 
not the intensity of light incident on a predetermined one 
of the pair of pixels is greater than the intensity of 
light incident on the other. 

24. A method according to claim 23, wherein in step (b), 
at leeist one pair of pixels is selected for each of a 
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plurality of cells. 

25. A method according to claim 24, wherein in step (b), a 
plurality of pixels is selected for each cell of the image 
field. 

26. A method according to any of claims 23 to 25, wherein 
the same pixels are used in each frame until the end of 
the operating session. 

27. A method according to any of claims 23 to 26, wherein 
the binary signals are used to generate pointers for 
addressing the memory containing the time history of the 
image. 

2ff. A method according to claim 27, wherein a set of 
pointers a , . . . ^ a is generated, each of n binary 
bits and said bits are sequentially set according to the 
respective binary values of the signals resulting from the 
comparisons of the pixel pairs. 

29. A device for analysing an electronic image signal, the 
device comprising electronic means for: - 

(a) proces8ing the image signal to regard it as 
representing one or more cells each comprising a plurality 

of pixels; and 

(b) for consecutive frames of the monitored image, 
randomly or pseudo-randomly selecting pairs of pixels in 
the cell or cells, as appropriate, and for each pair, 
generating a binary signal in dependence upon whether or 
not the intensity of light incident on a predetermined one 
of the pair of pixels is greater than the intensity of 
light incident on the other. 

30. A device according to claim 29, wherein said 
electronic means is adapted to select at least one pair of 
pixels for each of a plurality of cells. 
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31. A device according to claim 29 or claim 30/ wherein 
said electronic means is adapted to select a plurality of 
pixels for each cell of the image field. 

32. A device according to any of claims 29 to 31, wherein 
said electronic means is adapted to use the same pixels in 
each frame until the end of the operating session. 

33. A device according to any of claims 29 to 32, wherein 
said electronic means is adapted- to use the binary signals 
to generate pointers for addressing the memory containing 
the time history of the image. 

34. A device according to claim 33, wherein said 
electronic means is adapted to generate a set of pointers 
a^,-. ,a^/ each of n binary bits and sequentially to 

set these bits according to the respective binaary values 
of the signals resulting from the coir^arisons of the pixel 
pairs. 

35. A device according to any of claims 29 to 34, wherein 
said electronic means comprises an image frame grabber, a 
memory and one or more computer processors. 

36. A method of analysing an electronic image signal, the 
method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
generating characteristic values according to the detailed 
content of the image; and 

(c) generating a set of pointers a ,...,a , each 

X - m 

of n bits and sequentially setting these bits according to 
the characteristic values. 
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37. A method according to claim 36, wherein the pointers 
are used to address a memory array having m rows and 2 
columns, and the value of an address in each row indicated 
by the pointer corresponding to that row is updated, 

38. A device for analysing an electronic image signal, the 
device comprising electronic means for: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
generating characteristic values according to the detailed 
content of the image; and 

(c) generating a set of pointers a^, . . . , a^, each 

of n bits and sequentially setting these bits according to 
the characteristic values* 

39. A device according to claim 38, wherein the electronic 

means is adap;ted to xise the pointers to address a memory 

n 

array having m rows and 2 columns, and to update the 
value of an address in each row indicated by the pointer 
corresponding to that row. 

40. A device according to claim 38 or claim 39, wherein 
said electronic means comprises an image frame grabber, a 
memory and one or more computer processors. 

41. A method of analysing an electronic image signal, the 
method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the .monitored image, 
updating one address in each row of a memory array J. n 
dependence on the detailed content of the image; and 

(c) over all the rows, summing the values in the 
addresses being updated and summing the maximum value in 
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each row, subjecting the ratio of the two sums to a time 
weighted averaging with respect to the ratios obtained 
from previous frames comparing the ratio with the time 
weighted average and using the result to determine the 
occurrence or non-occurrence of a significant event within 
the image. 

42. A device for analysing an electronic image signal, the 
device comprising electronic means for: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(l>)for consecutive frames of the monitored image, 
updating one address in each row of a memory array in 
dependence on the detailed content of the image; and 

(c)over all the rows, summing the values in the 
addresses being updated and summing the maximum value in 
each row, subjecting the ratio of the two sums to a time 
* weighted averaging with respect to the ratios obtained 
from previous, frames, comparing the ratio with the time 
weighted average and \ising the result to determine the 
occurrence or non-occurrence of a significant event within 
the image. 

43. A device according to claim 42, wherein said 
electronic means comprises an image frame grabber, a 
memory and one or more computer processors. 




Figure 1 
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